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Abstract — This paper presents a bounded linear stability 
analysis for a hybrid adaptive control that blends both direct 
and indirect adaptive control. Stability and convergence of 
nonlinear adaptive control are analyzed using an approximate 
linear equivalent system. A stability margin analysis shows that 
a large adaptive gain can lead to a reduced phase margin. This 
method can enable metrics-driven adaptive control whereby the 
adaptive gain is adjusted to meet stability margin requirements. 


I. Introduction 

Adaptive control is nonlinear and stability of adaptive 
control cannot be analyzed by the traditional phase and gain 
margins. These margins are used for linear control laws to 
provide robustness in the presence of system uncertainties. 
The lack of stability metrics for adaptive control is a major 
challenge to certifying adaptive control for safety-critical 
systems. Metrics-driven adaptive control introduces a notion 
that adaptation should be driven by some stability metrics to 
achieve robustness [1], A bounded linear stability analysis 
method is introduced for analyzing adaptive control in terms 
of the linear stability concept by establishing an approximate 
linear equivalent system as a function of persistent excitation. 
This linear equivalent system is only used for analysis and 
not for actual adaptation, and can provide estimates of 
relative stability of nonlinear adaptive control for a given 
adaptive gain. By adjusting the adaptive gain during the 
adaptation to meet certain stability margin requirements, 
the adaptive law is thus made to be metrics-driven. The 
bounded linear stability analysis is studied in a framework 
of a hybrid adaptive control which blends both direct and 
indirect adaptive control to improve tracking performance 
[2], as shown in Fig. 1. 

In recent years, direct model-reference adaptive con- 
trol (MRAC) using neural networks has been a topic of 
great research interests [3], [4], [5], Indirect adaptive con- 
trol achieves adaptation by means of system identification 
of plant parameters or uncertainties based on certainty- 
equivalence control schemes [6], [7]. In this study, a re- 
cursive least-squares (RLS) indirect adaptive law is used as 
a parameter estimation technique to reduce the modeling 
error, while a direct MRAC law achieves a reduction in 
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the tracking error. The study shows that the hybrid adaptive 
control potentially can offer better tracking performance and 
can prevent problems with high-gain control using direct 
MRAC alone. 



Fig. 1 - Hybrid Adaptive Control Architecture 

II. Hybrid Adaptive Control 
Given a plant model as 

x = ApX + BpU (1) 

where x £ R" is a state vector, u £ R" is a control vector, 
and A p , B p £ R" x " are unknown. 

The objective is to produce a controller that enables the 
plant to follow a reference model described by 

X/n — A m x m 4~ B m r (2) 

where A m £ R' !X " is Hurwitz and given, B m £ R" x " is also 
given, and r £ R" £ is a bounded command vector with 
r £ R" £ J2?oo also bounded. 

Defining an estimator model 

x = Ax + Bu + © T <f> + u a j (3) 

where A, B £ R" x " are known, © T = [ AA AB ] £ R" x2 ", 
<I> = [ x T m t ] T G R 2 ", and u a d £ R" is a direct adaptive 
signal. 

Defining the tracking error as X — Xf fi X , the goal is 
to determine a controller that results in lim, _><*, |ij = 0. 
A dynamic inversion controller is designed from Eq. (3) 
to give the tracking error a second-order response with a 
proportional-integral feedback control as 

u = B^ 1 ^ x m —A p x + KpX + Ki j xdz — Uad'j ( 4 ) 

where A p = A + AA and B p = B + AB are estimates 
of A p and B p , K p = Amg{k Pt i,...,k p ^ n ) > 0, and K , = 
diag (k L \,....k l>n ) > 0. 


The tracking error dynamics are expressed as 

[ xdT + & J ‘F> + u at j — (A p —A)x— (B p — B)u 
Jo 

(5) 


x = —K p x — Kj 


Let e = J()XdT x 


", then 


e = A c e + b ^© T <f> 4- u a d — e^j 


A r = 


0 I 
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The direct adaptive signal is parameterized by a linear-in- 
parameter matched uncertainty as 


u a d = W J3 (x) 

where W £ K mx " is a weight matrix and p £ 
vector with Lipschitz properties 


dx 


< L 


for some constant L > 0. 

The adaptive law is given by 

w = -rp e T Pb 

where F > 0 G R is an adaptive gain and P > 0 £ 
solves the Lyapunov equation 

PA c +AjP=-Q 


0 = 
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The necessary condition is obtained as 
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where e = x — Ax — Bu is an estimation error which is 
assumed to be measurable and 


(7) 


( 8 ) 

l' n is a basis 


\\P(x)- P(x 0 )\\<C\\x-xo\\ (9) 

for some constant C > 0, which implies a bounded derivative 
I dP (x) 


( 10 ) 
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2nx2n 

( 12 ) 


where Q > 0 is a symmetric positive-definite matrix. 

AA and A B are estimated by an indirect adaptive law based 
on the recursive least-squares (RLS) method 


(13) 


(14) 


where nr = 1 + <E> R<S> € 1 is a normalization factor, R > 
0 £ M 2nx2 " is a covariance matrix. 

The proof of the RLS indirect adaptive law is as follows: 
Proof: Consider the following cost functional to be mini- 
mized 

/(©)=‘ 1 1 


(15) 
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which results in Eq. (13). Differentiation of the identity 
R l R =1 also yields Eq. (14). 

Proposition 1: The hybrid adaptive law can be shown to 
be stable and result in bounded signals. 

Proof: Let ©*, W* be constant ideal weights, and © = 
© — ©*, W = W W* be weight variations, then 0 = © and 
W = W. Consider the following Lyapunov candidate function 

V = e J Pe + trace (w t T _ 1 W + © T fr ^ (19) 

V is evaluated as 

V = e(XJP + PAfj e + 2 e T Pb (© T <L + W T p - e) 
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Since R [ R = I, then 

— (R~ 1 )R+R~ 1 R = — (R~ l )R-\<P<P J R = 0 (21) 

dt dt nr 

S ° „ . , 

( 22 ) 
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Using the trace property trace (AB) =BA, one then obtains 
V < -e J Qe + 2e J Pb (© T <I> + A 2 ) 


(<J> t 0-AJ1 © t <L- 


-T> t @© t T> (23) 
nr \ ' / nr 

where Ai = sup v „ |e — ©* T <f>| and At = sup A . u |W* T /3 — Aj | 
are approximation errors. 

V is bounded by 


V<-X min {Q)\\e\\ 1 + 2X, nax (P)\\e\\( K 
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Defining a compact set Y as 


Y={e£ R",© t 4> g R" : ||e|| >r x = 


XXmax (P) ||A 2 1| 

Xtn in ( Q ) 


© t 4 > 


>r 2 = 2r\m 2 ?i, nax ( P ) + 2 ||Ai || > (25) 


and a complementary compact set J/ which contains e = 0 
and © = 0, then V increases in .9' but all trajectories of 
e and © <J> will stay inside of SP . It follows by LaSalle’s 
extensions of the Lyapunov method that e and © are bounded, 
and so are x and u. 



III. Bounded Linear Stability Analysis 


Stability of nonlinear adaptive control is usually analyzed 
by the Lyapunov method. The traditional linear stability mar- 
gin concept may be extended to nonlinear adaptive control 
if it could be represented by some linear approximations. 
To obtain an equivalent LTI system, the adaptive law can 
be linearized at a certain point in time when the weights 
are at a steady state, usually long after initial transients have 
settled down. However, transient responses during adaptation 
can be important and the adaptive law should be designed in 
a way that would prevent large initial transients which can 
compromise system robustness. The bounded linear stability 
analysis seeks a piecewise linear equivalent approximation 
of nonlinear adaptive control in terms of a persistent excita- 
tion (PE) over a short, moving time window during which 
the LTI concept of stability margins could be analyzed to 
provide a method for adjusting the adaptive gain for the 
next time window. The linear equivalent approximation is 
not a replacement of an adaptive law but rather is used in 
conjunction with the adaptive law for the stability analysis 
purpose. 

Theorem 1: The hybrid adaptive law and the tracking 
error dynamics can be approximated by a piecewise linear 
representation as 
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Let si = W T p G R" and z 2 = G) 1 ^ G R". Then 


si = -b T Pep T rp + W J p (29) 

Z2 = — ^s 2 O t /M>+ \ U- ©* T o") O t M> + ® t 6 (30) 
m z m- V / 

Since p satisfies the Lipschitz condition and x is bounded 
because x and 11 are bounded, then p = ^-x is therefore 
bounded. Also, <j> is bounded since <j> = [ i T m t ] and 
u can be shown to be bounded by differentiating Eq. (4) as 


ii = B , 


A m x m + B,„r —ApX — b A c e 
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Let e 1 = sup r „ , 


w J p 


<t> R< t> 


Ai + 0 T O 


and e 2 = sup C H , | 
for t G (to — T, to] . These error terms come from the actual 
adaptive laws (11) and (13) and thus act as bounded distur- 
bances. Upon integration, one gets 


Zi (to) ~Z\ (to ~T) < - [ b T Pep T rpdt + 

Jt n -T 


t 0 -T 
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The mean value theorem for integration states that 

[ b F(t)G(t)dt = F(c) [ k G(t)dt (34) 

J a J a 

where c G [a,b\ and g(f) > 0. If G = 1, then the special case 
of the mean value theorem for integration is obtained as 

rb 

F (t) dt = F (c) (b — a) (35) 
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Applying the mean value theorem for integration then 
yields 


Zi {to)-zi (to-T) < -Tb T Pe[t\) [ p T pdt + E\T (36) 
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Applying the mean value theorem for integration once 
more gives 


f" <t> J <Pdt = <t>(h) J <i>(h)T 

Jto-T 


(39) 


If T is sufficiently small, then H ~ f 2 ~ f G (to — T, f 0 ] SO 
that 

1 0 


T> 

and 


(L) T <I>(fi)«4>(f 2 ) T <I>(f 2 ) = - [° 4> t T>* = 4 > 5 (40) 

1 Jto-T 
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, ~.Z2(to)-zi(to-T) ^ 

Z 2 ~ < —az 2 + £2 (42) 

The tracking error dynamics can also be written as 

e < A c e + b(z\ +z 2 + A 2 ) (43) 


Remark 1: The piecewise linear approximation of the 
nonlinear adaptive laws and the tracking error dynamics 
over a moving time window enables the adaptive control 
to be analyzed in the context of an equivalent LTI system 
from which system robustness can be assessed via the 



linear stability margin concept during that time window. The 
window width T can be adjusted to sufficiently capture initial 
transients for analyzing system robustness. 

Remark 2: The persistent excitation values /3 q and <t>g 
may be a more suitable choice than the standard persis- 
tent excitation definition which would be j f{°_ T Pfi T dt 
and j f}°_ T dt , respectively. The persistent excitation 

matrices are singular and so are not invertible. On the other 
hand, j 3 q and <t> ( 2 are zero only if j3 = 0 and <J> = 0. It 
can be shown that the tracking error depends on j3g and 
the approximation error of the direct adaptive law, while 
<t >5 affects the parameter convergence of the RLS indirect 
adaptive law. 

Proof: Eliminating z i and 7.7 in the linearly approximate 
tracking error dynamics results in 

(s 2 — A c s + rpQbb T P ^ e <b ^ \,2 Z2 + £l e 2 + 

(44) 

For R 0 <Pl 1 , a « 1 , the solution of zi is 

Z 2 (to) < [Z 2 (tQ — T)-£ 2 \e T + £2 


so in the limit zi converges to 

lim sup | Z 2 1 = £2 (45) 

to 


Therefore, the convergence of the tracking error can be 
found by 

lim sup \e | = tl £l + ( ^i~l p] ( 46 > 

to—>°° r P q A m i n (bb P) 


One should note that while increasing F /3q can help 
reduce the tracking error, the system robustness may be 
compromised when it is examined in the context of the LTI 
stability margins. 

To analyze the linear stability of the approximate tracking 
error and the hybrid adaptive law, the characteristic equation 
of closed-loop system is evaluated by the Schur complement 
formula as 


/ FB 2 bb T P\ 

det (si — A) = det (si + al) s det ( si — A c 4 2 j 

(47) 

where A is the state transition matrix in Eq. (26). 

Since K p and Kj are diagonal and represent individual loop 
gains for the tracking error, the determinant can be evaluated 
as 


the tracking error dynamics. On the other hand, the direct 
MRAC interacts intimately with the tracking error which can 
affect robustness of the direct adaptive law. For each loop, 
the characteristic equation is 

(s + a) (s 3 + k p s 2 + kts + F^p 2 2 S + F^p l2 ) =0 (49) 

For brevity, the subscript i is dropped. By factorization 
with residue, the characteristic equation can be written as 


(s + a)< (s + F/IqO:) (k p — Ffip l ct)s-\-ki-\-Ff$Qp22 


-Fp 2 a(k p -Fp 2 a) 


+ r > = 0 (50) 


where a and the residue r are defined as 

a = (k i + rtip 22 y 1 p l2 (51) 

r = rffipn ~ r/3 0 2 a [hi + Tp 2 p 22 - F/3 0 2 a (k p - rp 2 a)] 

(52) 

For rp 2 p 2 2 'A> ki , which corresponds to fast adaptation and 
or large persistent excitation, then 

a = ( r PoP22) 1 P12 (53) 

r= -P 22 P 12 \ki-pf 2 Pi 2 {kp-PnPu)] ( 54 ) 

For the ideal tracking error response with A p = A and 
B p = B , the characteristic equation is second-order with 
a = 0 and T = 0 in Eq. (50). For the system to have good 

damping characteristics, the closed-loop poles should be a 

2 

complex-conjugate pair. This implies k, > -f in order for 
Re [—A m ax (-4 C )] to be largest. Then 

P 22 P 12 = k p (1 + ki) - 1 < k p ^1 + ^ (55) 

Thus r is relatively small if k p is sufficiently large and 
therefore can be neglected. Then, the approximate roots of 
the characteristic equation (50) are 
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-r ft 2 a = -P22P12 



(56) 

(57) 

(58) 


det (si — A) = (s + a)" x 

n 

x (s' + kpjS~ + kjpS + FpQP22,iS + FpQPi2,i) ( 48 ) 

(—1 

where p l2 j = qkf' and p 2 2 ,< = qk ~ j (l +kf'^ ,i = 1 , . . . ,n, 
are diagonal elements of partitioned matrices P 12 and P 22 of 
P, which solves Eq. (12) with Q = 2ql, where q > 0 is a 
constant. 

The linear equivalent effect of the RES indirect adaptive 
law is to add a pole at s = —a, but it does not interact with 


where k p and kj are the linearly approximate adaptive pro- 
portional and integral gains defined as 

k p —k p P 22 P\2 (59) 

h = ki + rj3 0 2 p 2 2 - P 22 P 12 (k P - P 22 P i 2 ) (60) 

Equation (58) reveals that as r/3 ( j increases for fast adapta- 
tion and or large persistent excitation, the imaginary part of 
the complex-conjugate poles becomes large. Consequently, 
fast adaptation will result in high frequency oscillations in 
adaptive signals, a well-known fact in adaptive control [8], 



This high frequency oscillation can result in excitation of 
unmodeled dynamics that may be present in the system and 
therefore can lead to a possibility of instability. The approx- 
imate bounded linear stability method is able to capture this 
behavior of nonlinear adaptive control in the linear analysis 
context. This method should be able to provide a method for 
assessing linear stability margins that can be used to adjust 
the adaptive gain. 


IV. Metrics-Driven Adaptive control 
Metric-driven adaptive control is an approach that ad- 
dresses stability and robustness of adaptive control in terms 
of quantifiable metrics. The goal of metrics-driven adaptive 
control is to achieve adaptation that satisfies a given set 
of metrics. Since adaptive control is nonlinear, the notion 
of metrics is not well established. Lacking of appropriate 
metrics for nonlinear adaptive control, the bounded linear sta- 
bility analysis method can provide a framework for metrics- 
driven adaptive control whereby the nonlinear adaptive law is 
approximated by a linear equivalent system. Stability of the 
approximate LTI system can then be quantified in terms of 
gain and phase margins. These margins define how close to 
the verge of instability a control system is when subjected to 
disturbances. The adaptive gain can then be estimated from 
the bounded linear stability analysis method to meet specified 
margins and then used to drive the adaptation. Based on this 
approach, the system transfer function is obtained by taking 
the Laplace transform of the plant model as 


*-i / l T a r fslb J p 
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The open-loop transfer function between x and x is 
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The RLS indirect adaptive law results in convergence of 

1 . Then, the transfer function 


becomes 
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(63) 


G* (s) can be broken into individual SISO transfer func- 
tions from which stability margins can be computed. Stability 
margins of G(s) can be evaluated by structured singular 
values, or by one loop at a time and then the worst- 
case stability margins could be estimated using multi-loop 
stability margin definitions [9]. The stability margins are 
generally functions of Fy3(j. The persistent excitation /j ( y can 
be computed from Eq. (27) within a given time window. 
Using this value, the adaptive gain F can be calculated and 
used for adaptation for the next time window. This process 
is repeated until F should reach a steady state value when 
the weights no longer vary. 


V. SIMULATION 

To illustrate the bounded linear stability analysis method, a 
simulation was performed for a damaged twin-engine generic 
aircraft with 25% of the left wing missing [2], as shown in 
Fig. 2. The hybrid adaptive control is implemented in a flight 
control to track a pitch doublet. 



Fig. 2 - Damaged Generic Aircraft 
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Fig. 3 - Pitch Rate Tracking Error 

Figure 3 is a plot of the pitch rate tracking error. Without 
adaptation (r = 0, R = 0), the tracking performance of the 
flight control is quite poor as the tracking error is large. With 
the direct MRAC alone (r = 10 4 , R = 0), the tracking error 
becomes smaller but high frequency contents also appear. 
This is consistent with the closed-loop pole analysis. With 
the hybrid adaptive control (r = 10 4 , R = 10 4 /), the tracking 
error is significantly reduced along with the high frequency 
contents. Thus, the hybrid adaptive control appears to be 
more effective than the direct MRAC alone 
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Fig. 4 - Root Locus for Pitch Loop 

Figure 4 is the root locus plot of the characteristic equation 
for a = 1 when Ro^ 1 . The root locus plot agrees well 



with the closed-loop pole analysis. The imaginary part of 
the complex-conjugate poles increases with increasing the 
adaptive gain T. This gives rise to high frequency oscillations 
in the adaptive signals when F is large. 
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Fig. 5 - Bode Plot of G* (s) of Pitch Loop 

Figure 5 is the Bode plot of the transfer functions G* (s) 
evaluated for the first 5 seconds. The Bode plot shows that as 
r increases, the phase margin deteriorates. This is a typical 
behavior of a high-gain controller. Thus, while increasing F 
leads to a better tracking performance, the relative stability 
of the system is compromised, as high frequency signals can 
excite unmodeled dynamics and lead to instability [7]. 



Fig. 6 - Phase margin 

Figure 6 is a plot of the phase margin versus T. Increasing 
r causes the phase margin to decrease. MIL-F-9490 speci- 
fication for flight control systems typically requires a phase 
margin of 45° and a gain margin of 6 dB. The adaptive gain F 
corresponding to this phase margin specification establishes 
an upper bound F max for metrics-driven adaptive control. 
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Fig. 7 - Metrics-Driven Hybrid Adaptive Control 


Figure 7 is a plot of the pitch rate doublet tracking and 
roll and yaw rate responses to meet a phase margin of 45° 
with an adaptive gain F = F max . The hybrid adaptive control 
(r = F max , R = 10 4 /) clearly performs better than the direct 
MRAC alone (r = F max . R = 0) , which suffers large initial 
transients, although high frequency contents no longer appear 
in the signals. 

VI. Conclusions 

This paper has presented a bounded linear stability analy- 
sis method for analyzing approximate linear stability margins 
of a nonlinear hybrid adaptive control that blends both direct 
and recursive least-squares indirect adaptive laws. A piece- 
wise, approximate linear equivalent system is formulated 
over a short, moving time windows within which the stability 
margins are analyzed. The analysis relates the convergence of 
the tracking error with the persistent excitation for the direct 
adaptive law, and the parameter convergence of the plant 
model with the persistent excitation for the indirect adaptive 
law. The closed-loop poles of the approximate linear equiva- 
lent system shows that increasing the adaptive gain results in 
high-frequency oscillations in the adaptive signals. A margin 
analysis shows that increasing the adaptive gain causes the 
phase margin to decrease. Thus, there exists an upper bound 
for an adaptive gain that satisfies a specified phase margin. 
This adaptive gain is used to limit the direct adaptation in the 
hybrid adaptive control to provide robustness. The simulation 
shows that the metrics-driven hybrid adaptive control has a 
better tracking performance than the direct adaptive control 
alone. 
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